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Abstract 

One goal of professional development is to improve student achievement through improved teacher practice. 
The middle school philosophy, which supports the rationale that student learning is inextricably interwoven 
into the fabric of an active learning environment, contains many promising practices that “mirror” what is 
often considered to be high quality professional development. However, researchers’ efforts to identify and 
measure this relationship have proven difficult at best. In this study, levels of professional development as 
components of various school reform initiatives are identified, and their relationships to student learning are 
measured across various grade configurations, specifically, K-8, 6-8, and 7-12. 

This study found a significant percent of 6-8 middle level schools to be more highly engaged in professional 
development activities than their K-8 and 7-12 counterparts. However, when taken together, professional 
development and grade configuration were not found to have a direct relationship to student achievement. 
Some variance in state assessment scores, albeit not statistically significant, was found to be marginally relat- 
ed to grade configuration, indicating the need for further study. This finding, coupled with other analyses of 
the data, suggest that relationships among professional development, grade configuration, and student achieve- 
ment may exist but cannot be fully explained until researchers are able to identify and account for other vari- 
ables that may be related to the unexplained variance. Until empirical evidence is produced, policymakers are 
encouraged to continue discussions regarding the most appropriate means of addressing young adolescents' 
academic needs regardless of other factors. 


Background 

The ultimate goal of much professional development is to improve student achievement by improving teacher 
practice. Therefore, it is critical that researchers study the effectiveness of professional development by meas- 
uring its implied, indirect, and direct impact on student learning. For years researchers have struggled with 
numerous methodological barricades to determining the direct impact professional development has on stu- 
dent outcomes. “Although it is generally assumed that there is a strong and direct relationship between staff 
development and the improvement in student learning, efforts to clarify that relationship have met with little 
success” (Guskey & Sparks, 1996, p. 1). However, some reports from the National Staff Development Council 
have claimed that evidence does exist to suggest a relationship between teacher professional development and 
student achievement (Sparks, 2001). In addition, clear goals should be established within a school system to 
guide professional development utilizing student data to inform decisions. According to many who have stud- 
ied teacher professional development, little impact on student outcomes has been documented. This has led 
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some, Mizell (2001), for example, to recommend the development and implementation of professional devel- 
opment standards believed to influence the quality of staff development. While professional development can 
occur independently, it is important that common ground be met. Such common ground can provide a basis 
for addressing student achievement. 

During a recent “study of studies” examining the existing body of middle school research conducted between 
1991 and 2002, Hough and colleagues noted that key questions pertaining to the impact of middle level edu- 
cation on student outcomes, especially those focused on professional development and student achievement, 
have yet to be addressed. In addition, Hough (2003) noted that less than 4% of all research on middle level 
student achievement utilizes experimental or quasi-experimental designs. Seldom do educational researchers 
design scientifically randomized studies that include controls. 

To examine more carefully the impact of middle school teacher professional development on student achieve- 
ment, researchers should design experimental or quasi-experimental studies. Also, Hough (2003) advocates 
for matched pairs designs in which researchers compare middle level schools highly engaged in professional 
development to those not highly engaged. In so doing, differences in teacher beliefs and practices and their 
impact on student achievement should also be examined to address this important, yet methodologically prob- 
lematic, issue. 


Related Literature 

Traditionally, professional development has consisted of so-called “one shot” workshops, seminars, or confer- 
ences. Research has found that successful implementation of concepts learned during these types of work- 
shops is rare. A growing body of research in the area of professional development evaluation supports the con- 
tention that conventional workshops are not the most effective, efficient way to improve teaching and learning 
(Corcoran, 1995). Too often, little is taken into account regarding how professional development will fit into 
the current program or how it will continue (Sparks & Hirsh, 1997). Over the last decade, however, increasing 
concern has developed regarding the effect, if any, these types of professional development activities actually 
have on teaching and learning in classrooms, schools, and districts (Darling-Hammond, 1998a; Guskey, 1999; 
Guskey & Sparks, 1996). Evidence has shown that professional development can result in changes in teacher 
practice if the professional development activities are sustained over a period of time (Abdal-Haqq, 1996; 
Darling-Hammond, 1998). Common, successful procedural characteristics are found in schools that have high 
levels of involvement in professional development. The key to successful professional development programs 
appears to lie in an organizational system that provides ongoing, site-based, job-embedded, systemic, focused 
efforts to effect system-wide change, derived from client needs (Hirsh, 2000). 

Growing opinion among some scholars suggests that, when implemented properly, professional development 
can benefit student learning. According to Darling-Hammond and McLaughlin (1995), successful professional 
development strategies are: experiential, grounded in participants' questions, collaborative among educators, 
connected to and derived from work with students, sustained and intensive, and linked to other school aspects. 
The effectiveness of professional development is measured by its implied impact on student learning. 
According to some educators, “most recognize that effectiveness in teaching is not defined by what they do as 
teachers but by what their students are able to do” (Guskey, 2001, p. 3). Unfortunately, there are numerous 
methodological barricades to determining the direct impact professional development has on student achieve- 
ment. 

In their book, A New Vision for Staff Development, Sparks and Hirsh (1997), discuss their contention that stu- 
dent learning cannot be linked exclusively to professional development. Other factors, such as school leader- 
ship, the application of academic standards, and the quality of curriculum all play a role in student achieve- 
ment. As a result, the National Staff Development Council (NSDC) created professional development stan- 
dards to provide a benchmark for program comparison and improvement ( Sparks , 2001). According to the 
NSCD, high-quality professional development programs are essential to creating schools in which all students 
and staff members are learners who continually improve their performance. Clear objectives should be formu- 
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lated within a school system to guide professional development, utilizing student data to inform decisions. 
Professional development can occur independently; however, it is important that common ground be met. This 
common ground can provide a basis for successful goal achievement. It is important that objectives be clearly 
defined, have a school-wide focus, are limited in number, and are achievable ( Sparks , 1999). A set plan 
should relate current practices and establish ongoing procedures that lead to improvements in student achieve- 
ment. Continuous evaluation at various levels and intervals should also be considered when setting goals and 
procedures. Evaluating activities can provide important information to assist in making educated decisions 
regarding professional development processes and effects (Guskey, 1999). 

School-based reform initiatives and staff involvement in professional development do not always guarantee 
that student learning will increase, however. While many experts believe professional development should 
focus on collaborative, active learning processes, noticeable increases in student learning are often found 
when students engage in integrated, creative problem solving processes. These aspects of learning are the 
same techniques teachers utilize to inspire their students to learn, engaging various types of learners. This type 
of active learning by teachers can “redefine their work in relation to the way the entire school works” 
(Lieberman, 1995). Individual teachers are afforded the opportunity to learn from fellow teachers in the same 
school, which encourages “constant learning” toward a larger goal (Lieberman, 1995). This type of “constant 
learning” can be fostered in various ways. Some schools develop teams to assess the degree to which profes- 
sional development is meeting the needs of teachers and to discuss proposed changes. This also provides team 
members with the opportunity to discuss the impact this type of professional development has on addressing 
student needs and exchanging ideas, while building a sense of camaraderie within their school (Richardson, 
2000 ). 

Some scholars believe the team approach to whole-school reform undergirds many recommended middle 
school practices aimed a creating an environment supportive of the middle school philosophy and includes: 

curriculum that is challenging, integrative, and exploratory; assessment and evaluation that promote 
learning; varied teaching and learning approaches; flexible organizational structures; adult advocacy 
for every child; shared vision; high expectations for all; positive school climate; educators committed 
to young adolescents; programs and policies that foster health, wellness, and safety; family and com- 
munity partnerships; and courageous leadership. (NMSA, 2003) 

In recent years, there has been a growing appreciation for the role professional development plays and the 
potential impact it may have on overall school success. However, teachers, researchers, and policymakers tend 
to indicate that the greatest challenge to implementing effective professional development is “lack of time” 
(Abdal-Haqq, 1996). Cook (1997) also points out that, although time has emerged as the key issue in the 
analysis of school change, the challenge is not to find additional time within the school day; rather, a more 
efficient use of available time may be the key. Although many policymakers see professional development as 
inherently good, “more” doesn't necessarily equate with “better.” Quality professional development should be 
implemented wisely, efficiently, and effectively (Guskey, 1999). Loucks-Horsley (1998) notes that the critical 
element to the success of change or reform efforts in schools relies on the people involved, the processes uti- 
lized, and the policies established. “Unlike most professional development strategies with their ‘one size fits 
all' orientation, networks, coalitions, and partnerships provide opportunities to commit themselves to topics of 
intrinsic interest of that develop out of their work” (Lieberman, 1995, p.9). 

To achieve high levels of student achievement, teachers must first be skillful and knowledgeable in their meth- 
ods and schools must make the commitment to continuously support teachers' ongoing learning (Darling- 
Hammond, 1998b). Continued research and the gathering of additional evidence that links professional devel- 
opment and student achievement is needed. Perhaps equally important is evidence that reflects the impact pro- 
fessional development has on the practice of teaching and how such changes in teaching methods affect stu- 
dent learning. 

Therefore, the promising practices consistent with middle school philosophy and the types of professional 
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development designed to help them become fully implemented are in need of careful study to determine their 
impact on teaching and learning. Middle level schools highly engaged in professional development and those 
not highly engaged can serve as starting places to study the extent to which such efforts do, in fact, impact 
student achievement. 


Methods 


Sample 

The sample includes schools examined during a three-year longitudinal study of professional development 
(PD) centers in a Midwestern state. Descriptive data were used to examine the extent to which the PD centers 
were being accessed by teachers throughout the state, as well as to determine which characteristics could be 
used to identify “high” and “low” professional development sites as well as the relationship of these charac- 
teristics to teacher practice and student outcomes. 

Researchers employed a quasi-experimental design using a split-half mean to categorize schools as either 
highly engaged professional development sites (high PD) or minimally engaged professional development 
sites (low PD). Of the 43 schools included in the sample used for this study, 22 schools were categorized as 
high PD sites, and 21 were categorized as low PD sites. 

To achieve this sample, survey instruments were first mailed to principals at each of 500 schools within the 
state that contained a seventh grade; 255 principals returned useable questionnaires that were subsequently 
classified by the researchers as “elementary” (Pre K-6) and “secondary” (7-12) and rank ordered from highest 
to lowest based on the overall mean scores of questions concerning each school's level of involvement in pro- 
fessional development. One hundred schools with the highest grand means and 100 schools with the lowest 
grand means were labeled high PD and low PD professional development sites, respectively, and used for fur- 
ther analyses. Questionnaires were then mailed to teachers included in this sample. The final, usable sample 
(n= 128) included only those schools from which a 40% or higher return rate from teachers was achieved. This 
produced 65 high PD (33 elementary and 32 secondary) and 63 low PD (30 elementary and 33 secondary) 
sites. From these original 128 sites, 43 middle level schools were identified, categorized, and examined 
(again, 22 high PD middle level school sites, 2 1 low PD middle level school sites). 

Participants, Instrumentation, and Data Analyses 

Participants included 292 middle level educators from 43 middle level school sites. Program evaluation data 
included teacher-level and school-level information from each of these middle level schools representing three 
common grade configurations: 6-8 (n=27), K-8 (n=8) and 7-12 (n=8). 

The survey instrument included one set of nine questions pertaining to “Teacher-Related PD.” This scale was 
found to be reliable, yielding a Cronbach alpha r=.93. The survey also included a second set of nine questions 
named, “School-Related PD.” This second set of questions was also determined to be reliable, yielding a 
Cronbach alpha 1-.96. 

In addition, the state's school level demographic data were downloaded from the state department of educa- 
tion's website. These data include: student achievement scores, school demographics, and a measure of school 
“climate” based on parent, student, and teacher responses to their self study questionnaire. All data were 
entered into SPSS PC+ for analyses. 

Data analysis included an examination of group differences with regard to teacher perceptions of their 
involvement in professional development activities. In addition, school level data were examined to determine 
if differences exist in student outcomes as a result of teachers' participation in professional development. 
Analysis of variance, factor analytic techniques, and regression were utilized to examine data addressing the 
research questions. 
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Findings 

Of the 22 high PD middle level schools, a significant proportion (82%) were found to have a grade configura- 
tion containing grades 6-8. The remaining high PD middle level sites consisted of one 7-12 grade configura- 
tion school and three K-8 grade configuration schools. Of the 21 low PD middle level sties, 5 (24%) were K-8 
schools, 9 (43%) were 6-8 schools and 7 (33%) were 7-12 schools. 

FIGURE A. Grade configuration for middle level FIGURE B. Grade configuration for middle level 


sites categorized as high PD schools sites categorized as low PD schools 



Student Achievement 

State assessment data were collected for the 2000-2001 and 2001-2002 academic school years. These data 
were used for comparisons within the same years across school grade configurations and levels of profession- 
al development. 

Differences between high PD middle level sites and low PD middle level sites across the three different grade 
configurations were examined utilizing Analysis of Variance techniques. On average, high PD middle level 
sites scored consistently higher on the state's communication arts and mathematics assessments for both the 
2000-2001 and 2001-2002 academic years. Table 1 displays these data and can be summarized as follows: 

• Data indicate that, on average, a higher percentage of students (33.63%) attending high PD sites 
scored at the “Proficient” and “Advanced” levels on the 2001 communication arts tests than did stu- 
dents attending sites designated as low PD sites (30.83%). These differences were not found to be 
statistically significant [F(l ,4 1 )=.65 1 ; p=.424] and there was a small effect size estimate (d=.2459). 
However, during the 2002 school year the percent of students in high PD sites scoring at the 
“Proficient” and “Advanced” levels is about the same (29.57%) as students attending low PD sites 
(29.51%). 

• On average, high PD sites were found to have a higher percentage of students (13.51%) scoring at 

these two upper levels on the 2001 mathematic tests compared to 1 1.57% of students attending low 
PD sites. This trend was also found when examining scores for the 2002 academic year, with the per- 
cent of students scoring at these same levels in high PD sites (12.48%) higher than the percent of stu- 
dents in low PD sites (10.32%). While these differences exist, neither was found to be statistically 
significant [2001: F(l, 41)=0.375; p=.544; 2002: F(l, 41 )=1 .009; p=.322] and only a moderate effect 
size estimate was found for the 2002 mathematics scores (d=.31626). 
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TABLE 1. Comparisons of average percent of students scoring “proficient” and “advanced” on the state com- 
munication arts and mathematics assessments for the 2001 and 2002 academic years by high/low 
involvement in professional development. (n=43 schools) 



Assessment 

Year 

Grade 7 

Communication 

Ails 

State Affiessment 

(Minimum) 

(Maximum) 

Program Scores 

Giade 8 
Mathematics 

SD. 

(Minimum) 

(Maximum) 

HighPD 

Sites 

2001 

33j63% 

10.88% 

(13.20%) 

(51.70%) 

1331% 

12 04% 

(0.00%) 

(50.00%) 

2002 

29.57% 

12.15% 

(10.20%) 

(50.70%) 

12.48% 

6 46% 

(3.60%) 

(27.30%) 

Q 

Q. « 

2001 

3033% 

11.83% 

(5.90%) 

(51.10%) 

1137% 

7.46% 

(0.00%) 

(25.40%) 


2002 

2931% 

13 42% 

(5.90%) 

(66.00%) 

1032% 

7.13% 

(0.00%) 

(28.20%) 


When data were disaggregated according to grade configuration, differences were noted but, again, none were 
found to be statistically significant. However, a linear regression model was also used to examine the variance 
in state assessment scores for the communication arts and mathematics scores based on grade configuration 
across both high PD and low PD middle level schools. While no significant relationships between professional 
development and student achievement were found for communication arts, a model producing a statistically 
significant relationship was found for mathematics scores. Table 2 displays the model's summary data for the 
latter. This regression model examining grade configuration accounts for 12.3% of the variance (R2=.123), 
producing an omnibus F(l,38)=(p=.027). 

TABLE 2. Linear Regression model examining grade configuration and the variance in student achievement 
scores in mathematics for the 2002 academic year. 




Sva of 
Squires 

df 

Mein 

Squire 

F 


Motfel 

Regret lion 

221.370 

1 

221.370 

5.5315 

.027 


Re aduil 

1582.629 

38 

41.648 




Total 

1803.999 

39 

41.648 




a Predictors: (Constant), K-8 to all 

e Dependent Variable: Math Assessment, Proficient and Advanced 2002 


Variables 

Unstandardized 
Co efficients 


Standardized 

Coefficients 

t 

Sig. 

(Constant=K-8) 

16.1000 

2.282 


7.056 

.000 

K-8 vs. 6-8 & 7-12 
configurations 

-5.881 

2.551 

-.350 

-2.305 

.027 


a Dependent Variable: Math Assessment, Proficient, and Advanced 


Grade configuration appears to explain some variance in math scores within this sample. However, other pre- 
dictors may very well exist, but due to the small sample size these variables could not be examined in a robust 
way through regression techniques. 

Administrator Questionnaire 

Data from the administrator questionnaires for all 43 middle level schools indicate that the number of students 
per school ranged from 85 to 1,151, with an average of 404 students per site (SD = 251.84). Schools con- 
tained approximately 35 teachers per site, with the number of teachers ranging from 12 to 89. Twenty-three 
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percent of middle level school administrators surveyed reported their teachers were actively engaged in pro- 
fessional development. On average, administrators noted 64.71% of teachers actively engaged in PD. Eighteen 
percent of the middle level school administrator respondents indicated their schools participated in some type 
of school-wide reform initiative. The reform initiative noted most often by respondents was Accelerated 
Schools, which represented 11.6% (n=5) of the 43 schools examined. 

Factor analytic techniques were used to examine the 18 questions pertaining to professional development on 
the administrator survey instrument. Maximum Likelihood extraction methods were employed, and two fac- 
tors were retained after using Direct Oblimin rotation on the factor matrix. The nine variables loading on the 
first factor were termed “teacher-related PD” and the nine variables loading on factor two were termed 
“school-related PD.” The scale produced from the nine questions pertaining to “staff-related professional 
development” was found to be reliable, yielding a Cronbach alpha 1-.95. The second scale produced from the 
remaining nine questions, “school-related professional development” was also determined to be reliable, 
yielding a Cronbach alpha 1-.93. (The Likert-type scale was: 1 = strongly disagree, 2, disagree, 3 = somewhat 
disagree, 4 = somewhat agree, 5 = agree, 6 = strongly agree). 

When data were disaggregated to examine only those schools defined in this study as middle level sites, 
administrators rated the questions concerning increased use of performance assessments (M=5.16), enhanced 
techniques (M=5.12) and improved knowledge of current trends (M=5.12) highest among the second set of 
nine questions pertaining to staff-related PD. Motivating teachers to become involved in school-wide reform 
was rated lowest (M=4.67) by administrators. Middle level administrators rate support of innovative teaching 
(M=5.55), encouraging teachers to participate in systemic PD (M=5.51) and the alignment of school PD plans 
(M=5.43) highest among the nine questions pertaining to school-related PD; providing financial support 
opportunities for teachers working on PD plan goals was rated lowest by administrators (M=5.03). 

During the larger study researchers rank-ordered schools based on the overall mean scores from administrator 
respondents on the first set of nine questions pertaining to staff-related PD and the second set of nine ques- 
tions pertaining to school-related PD. Once schools were rank-ordered, the research team selected the highest 
100 scores (elementary=50, secondary=50) and assigned those sites the label high PD sites. The lowest ranked 
100 schools (elementary=50, secondary=50) were also selected and assigned the label low PD sites. These 
200 school sites then became the sample for the teacher survey questionnaire. 


TABLE 3. Total variance explained in Factor Analysis procedures on the administrator survey instrument 


Factor 

Initial Eigenvalue 

Extraction Sums of Squared Loadings 

Rotation 


Total 

% of Variance 

Cumulative 9b 

Total 

9b of Variance 

Cumulative 9b 

Total 

1 

10.582 

58.790 

58.790 

10.262 

57.011 

57.011 

9.052 

2 

2.153 

11.961 

70.752 

1.833 

10.181 

67.191 

8.710 

3 

0.796 

4.420 

75.172 


4 

0.750 

4.167 

79.339 


5 

0.559 

3.103 

82.443 

6 

0.488 

2.710 

85.153 

1 

0.436 

2.420 

87.573 

8 

0.379 

2.106 

89.679 

9 

0.308 

1.709 

91.387 

10 

0.262 

1.454 

92.841 

11 

0.233 

1.292 

94.134 

12 

0.208 

1.155 

95.289 

13 

0.186 

1.032 

96.321 

14 

0.170 

0.946 

97.267 

IS 

0.157 

0.874 

98.141 

16 

0.133 

0.738 

98.879 

17 

0.103 

0.574 

99.454 

18 

0.098 

0.546 

100.000 
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Figure 1 . Scree Plot of Eigenvalues for Ihe Adrmnstrator Survey Instrument 



TABLE 4. One-way ANOVAs for middle level administrators' responses to survey questions regarding school 
(n=9) and staff (n=9) professional development involvement. 



1 


I 


Survey Quertu n 

Mi 

Mi 

F 

Significance 

fitY SCHOOL 

1 ...has a focused PD plan 

586 

4.76 

26210 

000 

2 . . . alibis its PD plan to me at CSIP goals 

590 

495 

22.727 

000 

3 ...supports development /achievement of teachers' PD plans 

586 

438 

28870 

000 

4 ... provides teachers w/PD apportuniies to meetplan goals 

586 

438 

25.794 

000 

5 ...provides administrative supportf or PD plan goals 

586 

4.48 

28.428 

000 

6 ... provide s financ ial supportfor PD plan goals 

567 

428 

12.745 

KB 

7 ...supports innovative teaching practices in the classroom 

590 

5.19 

8.555 

■a 

8 ...encourages continuous & systemic PD 

595 

505 

20234 

000 

9 ...supports student achievementthrou^a effective PD 

582 

490 

19261 

000 

WY STAFF'S PARTICIPATION IN PROFESSIONAL DEVELOPMENT AC HVITTES HAS 

1 ... enhance dtechniques^aactices in the classroom 

564 

457 

35098 

000 

2 ... improved knowledge of current trends in e duration 

550 

4.71 

23074 

000 

3 ... strenghened aJbiliy to meet studentne eds 

555 

4.48 

34279 

000 

4 ... inaease duse of performance asse ssment tasks 

5.45 

486 

6.041 

IPP 

5 . . .motirated te achers to be come engaged it school-wide reform 

532 

4.14 

22254 


6 ... improved students' clasa'oom participation/interaction 

5.41 

462 

16.795 

000 

7 ...motivated student enthusiasm in learning new concepts 

529 

405 

30314 

000 

8 ... increase d academic perf armanc e of all students 

527 

4.15 

15.129 

000 

9 ... de velcped student confident e it performance asse ssment 

523 

4.10 

15818 

000 

bTote: Sigttific ant difference s are presented ia bold, face type . Significance based on p < JOf. 


Mi = Hi^nPD sites, Mj= Low PD sites) 






Teacher Questionnaire 

During this three-year statewide study, a total of 200 schools elementary (high PD=50, low PD=50); second- 
ary (high PD=50, low PD=50) received a teacher survey instrument. For the purpose of this analysis, only 
those teachers associated with middle level sites with grade configurations of 6-8, K-8, and 7-12 were includ- 
ed in the following analyses. Data from 292 middle level educators (high PD schools=151; low PD 
schools=141) completing the survey questionnaires yielded the following: 

Of the 292 teachers responding to the survey instrument, 151 (51.7%) were associated with high PD sites and 
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141 (48.3%) were associated with low PD sites. Data indicate that overall, 20.3% (n=55) of the teachers sur- 
veyed reported their school to be engaged in some type of school-wide reform initiative. On average, middle 
schools identified as high PD sites had a higher degree of involvement in school-wide reform (26.3%) than 
did middle schools identified as low PD sites (14.2%). 

On average, middle level teacher respondents associated with high PD sites indicated their school sponsored 
approximately eight professional development activities during the 2001-2002 school year (M=8.06; 

SD=6.91), while teachers associated with low PD sites reported their school sponsored approximately seven 
professional development activities (M=6.76; SD=6.70). Overall, 120 (41.1%) of the 292 middle level educa- 
tors responding had served on their school professional development committee. Of those serving, high PD 
sites (44.0%) had a higher percentage of teachers serving than did low PD sites (38.3%). 

As with the administrator survey instrument, factor analytic techniques were utilized to examine the 1 8 ques- 
tions pertaining to professional development contained in the teacher survey instrument. Maximum Likelihood 
extraction methods were employed, and two factors were retained after using Direct Oblimin rotation on the 
factor matrix. The nine variables loading on the first factor were termed “teacher-related PD” and the nine 
variables loading on factor two were termed “school-related PD.” The scale produced from the nine questions 
pertaining to teacher- related PD were found to be reliable, yielding a Cronbach alpha r=.93. The second pro- 
duced from the remaining nine questions, “school-related professional development” was also determined to 
be reliable, yielding a Cronbach alpha r=.96. 

Middle level teachers rated improved knowledge of current trends (M=5.11) and increased use of performance 
assessments (M=5.03) highest among the nine questions loading on the first factor staff-related PD. 

Motivating teachers to become involved in school- wide reform was rated lowest (M=4.51) by teachers. 
Teachers rated aligning PD plans with school improvement goals (M=5.46), and their school's support of 
innovative teaching practices (M=5.33) highest among the nine questions loading on the second factor school- 
related PD. Providing financial support for teacher working on PD plans was rated lowest among teacher 
respondents (M=4.83). 

Teachers associated with high PD sites rated both their school's PD and their own professional development 
higher on each of the 18 questions than did teachers associated with low PD sites. 
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TABLE 5. One-way ANOVAs for middle level teachers' responses to survey questions regarding school (n=9) 
and staff (n=9) professional development involvement. 




Survey Question 

M, 

Hi 

F 

Significance 


VI Y SCHOOL 


1 

has afocused PDplan 

536 

5.18 

2.130 

.146 

m 1 

2 

..aligns its PD plan to meet CSIP goals 

553 

538 

1.864 

.173 

If 

3 

. . supports development / achievement of teachers' PD plans 

525 

5.14 

.785 

.376 

1 i 

4 

..provides teachers w/PD opportuniiestomeetplan goals 

536 

5.16 

2.670 

.103 

« Q 

5 

. provides admiimstrifive support for PD plan go alt 

531 

498 

6.349 

.812 

33 

6 

. provide s financ ial suppoitfor PD phn goals 

4 54 

4.71 

2.114 

.147 

it 

7 

. supports innovative teaching practi: es h the classroom 

5.43 

523 

3.482 

.063 

1 

8 

..encourages continuous & systemic PD 

539 

5.18 

3.051 

.082 

£ 

9 

seaport* student uliei'eiiiati through effective PD 

53* 

511 

5.151 

824 


VTY 

STAFF’ $ PARTICIPATION IN PROFESSIONAL DEVELOPMENT AC HVITIES HAS 

-g 

1 

.. enhance dtechniques^practices in the classroom 

509 

492 

1.912 

.168 

I 

2 

.. improved knowledge of current herds in e ducation 

5.17 

504 

1.198 

.275 

if 

| i 

3 

. . strenghened abiliy to meet stndentne eds 

5 89 

490 

2.750 

.098 

4 

.. increase duse of performance assessmenttasks 

5.10 

495 

1.582 

.210 

il 

5 

. .motivated te achers to be came engaged h school-wide reform 

459 

4.42 

1.538 

.216 

6 

..improved students' clasioam partkipationTinteractian 

483 

459 

3.460 

.064 

rfl 

7 

..motivated student enthusiasm in learning new concepts 

463 

4.48 

1.458 

.228 

J 

8 

..increased academic performance of all students 

463 

4.42 

2.822 

.094 

Ph 

9 

..developed student confident e in performance assessment 

4.74 

451 

3.225 

.074 


Nate: Significant differences are presented ii boldface type . Significance base dan p < J05 . 
(Til. = Hi^iPD sites, Mi = Low PD sites) 


TABLE 6. Pattern matrix from Exploratory Factor Analysis Maximum Likelihood extraction for the teacher 
survey instrument. 



Factor 1 

Factor 2 


Teacher PD 

School PD 

PD Opportunities 

-0.065 

0.907 

Continuous PD 

-0.063 

0.870 

Administrator Support 

-0.023 

0.861 

Supports Teacher PD 

0.007 

0.842 

Effective PD Activities 

0.050 

0.811 

Innovative Teaching 

0.017 

0.743 

Alignment of PD Plan 

0.044 

0.703 

Financial Support 

0.000 

0.673 

Focused PD Plan 

0.101 

0.673 

Student Participation 

0.938 

-0.045 

Student Motivation 

0.928 

-0.047 

Meeting Student Needs 

0.885 

0.028 

Student Achievement 

0.878 

-0.035 

Student Confidence 

0.859 

-0.040 

Performance Assessment 

0.851 

-0.007 

Classroom Techniques 

0.851 

0.033 

Knowledge Base 

0.765 

0.093 

Teacher Motivation 

0.706 

0.101 
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School Demographic Data 

The average number of students in those schools categorized as high PD sites (n=22; M=467.77) was higher 
than the average number of students in low PD sites (n=21; M=313.71). Difference in school size within these 
high PD and low PD site designations was found to be statistically significant [F( 1 ,4 1 )=4.22 1 ; p=.046]. On 
average, students attending schools labeled high PD sites had a lower average daily attendance (92.88%) than 
did students attending low PD sites (94.321%). However, these differences were not found to be significant. 
The average percent of students' receiving free/reduced lunch is also lower for high PD sites (40.19%) than 
low PD sites (48.71%). Again, these differences were not found to be significant, which may be due to the 
low sample size. Differences with regard to student ethnicity were also found not to be statistically significant 
when comparing high PD sites with low PD sites. 


TABLE 7. Average number, percent, and {standard deviation} of demographic characteristics collected per 
site as reported by the state Core Data for the 2001 academic school year by high/low involve- 
ment in professional development. (n=43) 


School 

typ* 

Average 
Nwnber of 
Students Per 
Ste 

Avaage 
Attendance 
Per Site 

Avaage %> 
Free |- ReAiced 
Linda Per 
ate 

Vilite 

Average 1 
Sad: 

% Etlwddty Pa Site 
Hispanic Asian 

American 
Inch an 

HigiPD 

467.77 

9288% 

40.19% 

84.30% 

10j66% 

2.22% 

1.05% 

1.79% 

Sites 

{2.77%} 

{24.11%} 

{ 17.82%} 

{ 15j62%} 

{3.27%} 

{ 1.42%} 

{685%} 

Low PD 

313.71 

9432% 

48.71% 

93.25% 

5.56% 

.73% 

32% 

.16% 

Sies 

{2.57%} 

{2901%} 

{23.31%} 

{2000%} 

{ 1.06%} 

{101%} 

{.374%} 

A vt Vo 

390.74 

93.60% 

44.46% 

88.78% 

8.11% 

L48% 

.69% 

.98% 

{SD} 

{2.67%} 

{2656%} 

{ 19.07%} 

{ 1781%} 

{2.17%} 

{1.22%} 

{361%} 

Sig of 

F = 4221 

F = 2j«74 

F = 1101 

F = 23t3 

F = 0 479 

F = 3.962 

F=3 717 

F=1 172 

Avaages 

p= (U04t 

p = » 111 

p = Cl JtKi 

p= 0359 

p = 0 356 

p = (Ki53 

p = (i (it 1 

p = 0 2*5 


Analysis of the Learning Environment 

Among the 43 schools included in the analyses, parents of students attending high PD sites rate their schools, 
on average, higher than parents with children attending low PD sites in each of the categories listed: 1) 

Quality of the Learning Environment, 2) School Safety, and 3) Adequate Resources. These differences were 
not found to be significant. Faculty responses to the additive scales reference 1) Parent Involvement, 2) 
Instructional Leadership, 3) Teacher Commitment, and 4) Professional Development. Faculty in high profes- 
sional development sites rate their schools higher on each of the categories listed than do faculty in low pro- 
fessional development sites. Again, differences were not statistically significant. 

TABLE 8. Average mean scores and { standard deviations } for the parent and faculty portions of the state's 

school improvement program “Additive Scale” collected via the state department website (Jan-Feb 
2002) by high/low involvement in professional development. (n=43) 



Note: Dite. Colkctel vi*DESE C o* Lhti. 2002 . 
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Policy Implications 

In their efforts to improve student achievement, policymakers would be better advised to concentrate on fully 
implementing middle school programs and providing high quality professional development for teachers to 
improve student learning than to engage in abstract debates over other factors not supported by research. 
Grade configuration appears to be one of those factors currently being debated for which the research regard- 
ing student achievement is inconclusive. Improving student performance on state assessments can best be 
achieved when an entire school community focuses on common goals as part of a whole school reform initia- 
tive. Because the middle school philosophy is one that supports “promising practices” and because some mid- 
dle level schools incorporate a team approach to teaching and are highly engaged in professional develop- 
ment, they may offer researchers “rich” fields for the study of these relationships and their impact on student 
outcomes, including but not limited to student academic achievement. 

Research conducted over the last 10 years examining grade configuration and the implementation of middle 
level programs, policies, and practices has produced conflicting results. Additional research examining both 
grade configuration and the level of implementation of middle level practices needs to be conducted to 
address more fully the relationship (if any) of grade configuration and student achievement. Controlling for 
common factors such as average daily attendance, socio-economic status, school size, student to teacher 
ratios, per pupil expenditures, and ethnicity (to list just a few) should also be considered when studying rela- 
tionships between grade configuration and student achievement. 

While there appear to be relationships between levels of professional development and middle level grade 
configurations, the relationship between these variables and student achievement remains inconclusive. Future 
study in this area should address the degree to which high PD middle level schools and low PD middle level 
schools are implementing the middle school philosophy. These relationships should then be considered when 
attempting to examine each variable's impact on student achievement. 
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